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Abstract: Poisson approximation using Stein's method has been extensively studied 
in the literature. The main focus has been on bounding the total variation distance. 
This paper is a first attempt on moderate deviations in Poisson approximation for 
dependent indicators. We obtain general results under local dependence as well as 
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1. Introduction 

Poisson approximation using Stein's method has been extensively studied 
in the literature. It has been applied to many areas ranging from computer 
science to computational biology. The main focus has been on bounding the total 
variation distance between the distribution of a sum of dependent indicators and 
the Poisson distribution with the same mean. 

Broadly speaking, there are two main approaches to Poisson approximation, 
the local approach and the coupling approach. The local approach was first 
studied by Chen (1975) and developed further by Arratia, Goldstein and Gordon 
(1989, 1990), who presented Chen's results in a form which is easy to use and 
applied them to a wide range of problems including problems in extreme values, 
random graphs and molecular biology. The coupling approach, which dates back 
to Barbour (1982) and Stein (1986, page 93), was developed by Barbour, Hoist 
and Janson (1992), who introduced monotone coupling and applied their results 
to random graphs and many combinatorial problems. A recent review of Poisson 
approximation by Chatterjee, Diaconis and Meckes (2005) used Stein's method 



2 



LOUIS H.Y. CHEN, XIAO FANG AND QI-MAN SHAO 



of exchangeable pairs to study classical problems in combinatorial probability. 
They also reviewed the coupling approach as suggested in Stein (1986, page 93). 

Although there is a vast literature on Poisson approximation, relatively little 
has been done on such refinements as moderate deviations. For sums of inde- 
pendent indicators, moderate deviations has been studied by Barbour, Hoist and 
Janson (1992), Chen and Choi (1992), and Barbour, Chen and Choi (1995). The 
latter two actually considered the more general problem of unbounded function 
approximation and deduced moderate deviations as a special case. However no 
such results seem to have been obtained for dependent indicators. This is proba- 
bly due to the fact that unbounded function approximation becomes much harder 
for dependent indicators. Indeed, the paper by Barbour, Chen and Choi (1995) 
was intended to be the first of two papers with the second being on dependent 
indicators (as was indicated in the title), but the second paper never materializes 
due to the difficulty of the problem. Although moderate deviations is a special 
case of unbounded function approximation, it is of a similar nature as the latter 
and as such it is also a difficult problem for dependent indicators. 

This paper is a first attempt on moderate deviations in Poisson approxima- 
tion for dependent indicators. We take both the local and coupling approach. 
Under the local approach we consider locally dependent indicators. Under the 
coupling approach we consider size-bias coupling, which is a general framework 
for the coupling approach of Barbour, Hoist and Janson (1992) and of Stein 
(1986) as reviewed by Chatterjee, Diaconis and Meckes (2005). 

This paper is organized as follows. Section 2 contains the main theorems, 
Section 3 applications and Section 4 the proofs of the main theorems. 

2. Main Theorems 

In this section, we state two general theorems on moderate deviations in 
Poisson approximation, one under local dependence and the other under size- 
bias coupling. 
2.1 Local dependence 

Local dependence is a widely used dependence structure for Poisson approx- 
imation. We refer to Arratia, Goldstein and Gordon (1989, 1990) for results on 
the total variation distance and applications. We prove a moderate deviation 
result under local dependence. Let Xi,i S J , be random indicators indexed by 
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J = {!,-■■ ,n}. LetW = J2 ieJ X i , 

Pi = P(Xi = l), and A = ^ K >0. (2.1) 

iej 

Suppose for each i € J , there exists a subset Bi of J such that Xi is independent 
of {Xj : j ^ B{}. The subset Bi is called a dependence neighborhood of Xi. 
Assume that 

max \Bi I < m, (2.2) 

and for some 5, 6 > 0, 

£(^ ^ XjXjlW = u>) < 5w 2 for w < 9. (2.3) 

Let p = ma,Xi£j pi. Then we have the following moderate deviation result for W. 

Theorem 2.1. Let W = Xi be a sum of locally dependent random indi- 

cators with dependence neighborhoods Bi satisfying (|2,2p and (|2.3p . Then there 
exist absolute positive constants c, C such that for k > A satisfying 

k<6/Cm, p(l + £ 2 ) + JA(l + £ 2 + ^) < c 

v A 

where £ = (k — X) we have 
where Y ~ Poi(X). 



2.2 Size-bias coupling 

Baldi, Rinott and Stein (1989) and Goldstein and Rinott (1996) used size- 
bias coupling to prove normal approximation results by Stein's method. In the 
context of Stein's method for Poisson approximation, size-bias coupling was used 
implicitly by Stein (1986, page 93), Barbour, Hoist and Janson (1992, page 23) 
and Chatterjee, Diaconis and Meckes (2005, page 93). The following definition 
of size-bias distribution can be found in Goldstein and Rinott (1996). 

Definition 2.1. Let W be a non-negative random variable. We say that W s has 
the W -size biased distribution if 

EWf(W) = XEf(W s ) (2.4) 
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for all functions f such that the expectations exist. 

In this paper we assume W to be a non-negative integer valued random 
variable, in particular, a sum of random indicators. If we can couple W with W s 
on the same probability space, then we have the following bound on the total 
variation distance between C(W) and a Poisson distribution. 

Theorem 2.2. Let W be a non-negative integer valued random variable with 
EW = A > 0. Let W s be defined on the same probability space as W and has the 
W -size biased distribution. Then we have 

\\C(W) - Poi{X)\\ TV < (1 - e~ x )E\W + 1 - W s \. (2.5) 

Proof. Let h(w) = I(w G A) for w € Z + where A is any given subset of Z + . Let 
fh be the bounded solution (unique except at w = 0) to the Stein equation 

Xf(w + l) -wf(w) = h{w) - Eh(Y) (2.6) 

where Y ~ Poi(X). It is known that (see, for example, Barbour, Hoist and 
Janson (1992, page 7)) 

AA:= sup \f h (j + l)-f h (j)\<\-\l- e - x ). (2.7) 

jez+,j>i 

From (|2.6p and the fact that W s has the TV-size biased distribution and is coupled 
with W, we have 

\P(W £ A) — P(Y E A) | = \XEf h (W + 1) - EWf h {W)\ 

= X\E{f h {W + l)- f h {W s ))\ 

< XAf h E\W + 1 - W s \ 

< {l-e- x )E\W + 1-W S \ 

where the first inequality was obtained by writing fh(W + 1) — fh(W s ) as a 
telescoping sum and using the definition of A/^ along with the fact that W s > 
1. The second inequality follows from (|2,7h . Taking supremum over A yields 

(g^D - □ 

Similar results as Theorem 12.21 and their proofs can be found in Barbour, 
Hoist and Janson (1992) and Chatterjee, Diaconis and Meckes (2005). In order 
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for the bound (|2 . 5[) to be useful, we need to couple W with W s such that P|W^ + 
1 — W s \ is small. A general way of constructing such size-bias couplings for sums 
of random indicators is as follows; see, for example, Goldstein and Rinott (1996). 
Let X = {Xi}nzj where J = {1, . . . , re} be {0, l}-valued random variables with 

P(Xi = 1) = pi, A = Y.iejPi> and let W = T,iej x i- Let 1 G {!>••• ,n} be 
independent of X with P(7 = i) = Pi/X. Given /, construct X 1 = {Xj}j e j on 
the same probability space as X such that 

L{X] :jej) = C{Xj : j e J\Xj = 1). 

Then W s = Ylj^j Xj nas the W-size biased distribution. 

Under the setting of size-bias coupling, we prove the following moderate 
deviation result for Poisson approximation. 

Theorem 2.3. Let W be a non-negative integer valued random variable with 
EW = A > 0. Let W s be defined on the same probability space with W and have 
the W-size biased distribution. Assume that A := W + 1 — W s £ {—1,0, 1} and 
that there are non-negative constants 81,82 such that 

P(A = -1 I W) < &i, P(A = 1 I W) < 8 2 W. (2.8) 

For integers k > X, let £ = (k — X)/y/X. Then there exist absolute positive 
constants c, C such that for 

(St + 8 2 X)(1 + f) <c, 

we have 



P(W > k) 



P(Y > k) 



<C(8 l + 8 2 X)(l+f) (2.9) 



where Y ~ Poi(X). 



The conditions of Theorem 12.31 do not hold for all size-bias couplings. Nev- 
ertheless, in Section 3, we will be able to apply Theorem 12.31 to prove moderate 
deviation results for Poisson-binomial trials and the matching problem. 



3. Applications 

In this section, we apply our main results to 2-runs in a sequence of i.i.d. 
indicators, Poisson-binomial trials and the matching problem. 
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3.1. 2-runs. 

Let {£1, . . . ,£ n } be i.i.d. Bernoulli(p) variables with n > 10, p < 1/2. For 
each i G {l,...,n}, let X{ = £i£i+i where Cj+n = £,j-n = £j for any integer 
j G {1, . . . , n}. Define W = Y^h=i -^i with mean A = rap 2 . Then If is a sum of 
locally dependent random variables with m = 3 where m is defined in (|2.2p . For 
each i G {1, . . . , n} and any positive integer w < cnp for some sufficiently small 
constant c < 1/50 to be chosen later, we write 

P(Xi = l,X i+l = l,W = w) 

w) 



^] P(Xi- mi — • • • — Xi +ni2 — 1, Xi— mi -i — Xi +m2+ i — 0, w 

>0,m 2 
+m 2 < 

£ 



m l ^0> m 2 > 1 



>0,/ri2 > 1 
+1712 

where the sum is over integers. By writing 

n-(mi+m 2 +5) 

a mum2 =p mi+m2+2 (l-p) 2 P( £ Xi = io-(mi+m 2 + l)), 

i=l 

we have for mi + m2 + 1 < w, 

a mi>m2 +i _ p(J2^ mi+ " l2 ~ t " J ' Xi = w- (mi + m 2 + 2)) to 



n-(mi+m 2 +6) 

i=i 



a mi ,m 2 - p (E n = -( mi+m2+5 ) x . = w _ {mi+m2 + 1}) " 



for some positive constant C. The last inequality is proved by observing that 
for each event in the numerator {Xi : 1 < i < n — (mi + m 2 + 6)} such that 
^^(mi+m 2 +6) X{ = w — (mi + m,2 + 2), we can change one of the . . . 000 ... to 
. . . 010 . . . and let X n _^ mi+m2+5 ^ = 0, thus resulting in an event in the denomi- 
nator with probability at least c\p 2 times the probability of the original event for 
an absolute positive constant c\ . Summing over the probabilities of all the events 
resulted in such way and correcting for the multiple counts yield the inequality 
in (|3.ip . By choosing c to be small, 

a mi,m2+l ^ £ 
"mi,m2 ^ 

Similarly, 

"mi+l,m2 ^ 1 
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Therefore, 

P(AQ = 1, X l+1 = l,W = w)< Ca ,i < Cp 3 P{^2 Xi = w-2). 
Similar to ([370 . 

P(Y^ Xi = w-2)< C(w 2 /X 2 )P(W = w). 



n— 6 



n— 6 



i=l 



Therefore, 



w 



<C(p + pf+f/^) 



i=l j=i— 

= 2nP(AT; = Xi+i = 1, W = w)/P(W = w) 

< Cnp 3 w 2 /X 2 = —w 2 
np 

for w < cnp with sufficiently small c. Applying Theorem 12, 1[ there exist absolute 
positive constants c, C, such that for k > A and p + p£ 2 + £ 3 /\fn < c where 

e = (k - \)/Vx, 

P{W > k) 
P(Y > k) ' 

where Y ~ Poi(X). We remark that if A x O(l), then the range of £ above is of 
order Ofn 1 / 6 ). 

3.2. Poisson-binomial trials 

Let Xi,i G J", be independent with PpQ = 1) = pi = 1 - P(Xj = 0). 
Set A = X^iej'Pi ana ^ P = su PiejPi- Let = Xliej'^- Following the general 
way of constructing size-bias coupling stated in Section 2.1, W s in (|2.4f) can be 
constructed as VF S = W — Xj + 1 where / is independent of {AQ : i G and 
P(7 = i) = Pi/A for each i E J. Therefore, A = W + 1 — W s = Xi and condition 
(12.81) is satisfied with 



*i =0, 5 2 = p/X. 

Applying Theorem 12.31 there exist absolute positive constants c, C such that 



P(W > k) 
P(Y > k) 



1 



< cp(i + c 



(3.2) 
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for integers k > A and p(l + £ 2 ) < c where Y ~ Poi(A) and f = (fc - A)/\/A. 
The range p(l + £ 2 ) < c is optimal for i.i.d. case where Pi = p for all i € (see 
Theorem 9.D of Barbour, Hoist and Janson (1992, page 188) and Corollary 4.3 
of Barbour, Chen and Choi (1995)). 

Remark 3.1. The moderate deviation result (|3.2p also follows from Theorem \2.1\ 
for sums of locally dependent random variables. 



3.3. Matching problem 

For a positive integer n, let ir be a uniform random permutation of {1, . . . , n}. 
Let W = Ya l =i De the number of fixed points in ir. In Chatterjee, Diaconis 
and Meckes (2005), W s satisfying (|2.4j) was constructed as follows. First pick / 
uniformly from {1, . . . , n} and then set 



I i£j = I 

7T(I) ifj = 7T- 1 (I) 

ir(j) otherwise. 



Finally define W s = £™ =1 8 in s {i) . With A = W + 1 - W s , we have 

P(A = 1\W) = W/n, P(A = -1\W) = E{2a 2 \W)/n < 2/n 
where 02 is the number of transpositions of ir and the last inequality follows by 
E(2a 2 \W) = (n - W)/{n -W-l)<2 



for n - W > 2 and E(2a 2 \W) = for n- W < 1. By Theorem O with A = 1, 
there exist absolute positive constants c, C such that for all positive integers k 
satisfying k 2 /n < c, 

P(W > k) 



1 



< cr/n. 



P(Y > k) 

We remark that the order 0(l/n) is the same as that of the total variation 
bounds proved in Barbour, Hoist and Janson (1992) and Chatterjee, Diaconis 
and Meckes (2005). As remarked in both papers, this order is not optimal and 
it is an open problem to prove the actual order 0(2 n /n\) using Stein's method. 
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4. Proofs 

We use c, C to denote absolute positive constants whose values may be dif- 
ferent at each appearance. We start with two preliminary lemmas. 

Lemma 4.1. Let A > 0. Then for any integer w > A, 

yx \ wl{j + 1 \ <c. (4.i) 

Proof. By expanding the product (w+j + 1) x • • • x (w + 1) in terms of u; and then 
bounding it below by the first two and three terms respectively in the expansion, 
we have 

w\(j + l) „ ^ j + 1 



(j+w + l)! ^ (w + j + l) x ••■ x (w + 1) 



< 



c i E — -2+ E — ^—u- 

L ^ W+J 2 ^ W + J 2 + J w 



< 



< C, 

as desired. □ 
Lemma 4.2. Lei y ~ Poi(\) with A > 0. Then we have 

P(Y >k)>c>0 for all integer k < A, (4.2) 

P(Y > k) A 

> for all integer k > 1 (4-3) 



P(Y >yfc-l) - A + A; 
and 

+ 1 

P(Y > k) < P(Y = k)- — j-^-j for all integer k > A - 1. (4.4) 

Proof. The inequality in ()4.2p is trivial when A<lorl<A<C for some 
absolute constant C. When A > C, we can use normal approximation to prove 

For (|4.3p . noting that 

P(y >„ = p (r = , )(1 + _A_ + _^_ + ... ) 
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we have 

P(Y > k) P{Y = k - 1) k _ X 



P(Y>k-l) P(Y>k-l)~ X + k X + k 

The inequality in (|4.4p follows by observing that 

P ( y> fc) = p (y = fc)( i + -A- + (jb + i ^ + 2) + . 

= P(Y = k)- ' 



k-X + 1 



□ 

To prove moderate deviation results for Poisson approximation, we need to 
study the properties of the bounded solution fh (unique except at w = 0) to the 
Stein equation 

Xf(w + 1) - wf(w) = h(w) - Eh(Y). (4.5) 

where Y ~ Poi(X) and h(w) = I{w > k} for fixed integer k > X > 0. The 
bounded solution to (14.51) is 



fh{w) = - eX{ \ w 1)l E(h(Y)-Eh(Y))I{Y>w} 



(1 - P(Y > k))P{Y > w), w>k 



sA( ^~ 1)! P(y > k)P(Y <w- 1), 0<w<k-l 



For w > k, 



hW-Mw + 1) = e^! w eV-l)! 

i - p(y > fc) a™+* 1 - ; a™ { - ' 

j=w+l j=w 

V x j ( wl - 

^ + ^ + + 

^ (u,-l)!(j + l) 

^ (j + w + 
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and hence by (|4.ip 

< f h (w + 1) - f h (w) < fovw>k. (4.6) 

For w = k — 1 > 1, write 

f h (k-i) = f g (k-i)-f Sk _ 1 (k-i) 

where g(w) = I{w > k — 1} and S^—ifa) = I{w = k — 1}. Since 

o < hl _ m - /„_,<* - 1) . ^0^> + £0^> s _£_, 

together with (|4.6p . we have 

\f h (k - 1) - f h (k)\ < j^. (4.7) 

For < w < k - 2, 

/*(■»)-/*("+ a = £^ P(r < „) _ <^zll P(Y < w -d 

P(Y > k) X w + l y ~ 1 \™ y ~ > 

A poo A roc 

x w e~ x dx - ^— / x w ~ x e~ x dx 



(4- 



A 

/CO 
x w -\x-l)e- Xx dx 

POO 

= / x{l + x) w - l e- Xx dx. 
Jo 

For a non-negative integer valued random variable W with EW = A > 0, let 

P(W >r) . . 

: = SU P pfv ^ \ ( 4 - 9 ) 



where Y ~ Poi(A). By (1431) . 

P(W > r) 

sup J- ~ ( <rfe + C. (4.10) 

We are now ready to prove our main theorems. We first give the proof of 
Theorem 12.31 which is easier than that of Theorem 12.11 

Proof of Theorem \2.3[ For fixed integer k > A, let h(w) = I{w > /c} and consider 
the Stein equation (|4.5p . Observe that by (12. 4j) . for general / 



£(A/(W + 1) - = XE(f(W + 1) - /(W s ))- (4.11) 
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In particularly, for / := f^, 

Eh(W) - Eh(Y) =XE(f(W + 1) - f(W 3 )) 



(4.12) 



where 



H x = XE(f(W + l)-f(W + 2))I{A = -l}, 
H 2 = XE(f(W + l)-f(W))I{A = l}. 

Using (I2.8j) . the definition of r/k in (|4.9p . and the properties of fh, H± is bounded 
by 

< X5\E\f(W + 1) — f(W + 2)\(I(W + 1 > A; — 1) + I(W + 1 < fc — 1)) 

/"OO 

+A5iP(y > k)EI(W + 1 < jfe - 2) / x(l + x)^ w+l ^~ l e- Xx dx 

Jo 

< CP(Y > k)^( Vk + 1) + CP(Y > fc)5i(l + (/g ~ A)2 )(r? fc + 1) 

where we used (|4.10p . (j4.3|) and (|4.13p given in Lemma 14.31 below. 
Similarly, H 2 can be bounded as 

| #2 1 < X5 2 EW\f(W) - f{W + l)\(I(W > k-l)+I{W< k-1)) 

< CX5 2 P(W > k — 1) 

poo 

+X5 2 P{Y > k)EI(W <k — 2)W / x(l + x) w - l e~ Xx dx 

Jo 

< CP{Y > k)5 2 (k + A)(% + 1) + CP(Y > k)5 2 (k + {k- X) 2 ){ Vk + 1). 
by (|4.10p . (|4.3p and (|4.14p . Therefore, we obtain the following inequality. 

' pcrlfc) " 11 - c ^ k + Wi+5 2 x)(i + e). 

Since the right-hand side of the above inequality is increasing in k, we have the 
following recursive inequality for r/fe. 

1*7* — 1| < C{ Vk + l)(S 1 + S 2 X)(l + ^). 



The bound in (|2.9p is proved by solving the above recursive inequality. □ 
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We now prove the following lemma used in the proof of Theorem 12.31 

Lemma 4.3. Let Y ~ Poi(X) with A > 0. Let W be an integer valued random 
variable and for integers k > A, let rjk be defined as in (14. 9\\ . Then we have 

EI(W + l<k-2) I" xil+x^+^e-^dx < C{r jk + l){\+ ^ ~ A) ' ) (4.13) 

Jo a \ 2 

and 

f°° k (k — X) 2 

EI(W <k — 2)W / x(l + x) w - x e~ Xx dx < C(r] k + + - — r-^-). (4.14) 

Jo XX 

Proof. By integration by parts and (|4.10D . 

poo 

EI(W + 1 < k - 2) / x(l + x^+^e-^dx 
Jo 

pk—2 poo 

= - (/ x{l + x) t - 1 e- Xx dx)dP{W + \>t) 

Jo Jo 

poo k-2 

= -( / x(l + x) t - 1 e- Xx dx)P(W + 1 > t) 
Jo o 

pk-2 j poo 

+ / P(W + l>t) — ( x(l + x) t ~ 1 e- Xx dx)dt 
Jo dt J 



poo 

< C( % + 1)(/ aj(l + aj)^- 2)-1 e- A!e da;)P(y + l>ife-2) 

poo 

+C(r] k + 1)£I(Y + 1 < k - 2) / x(l + x)( y+1 )- 1 e- Aa; dx. 



From 033 it follows that for k - 2 > 1, 



poo 

/ s(l + x)^ 2 )- 1 e" Ax dx)P(y + 1 > k - 2) 
Jo 



= [^^P(Y<k-2)- e -^^P(Y<k-3)}P(Y>k-2) 

< "-^T^FiY = k - 2)P(Y >k-2) + ^^(^ - 1)P(Y >k-2) 

P(Y>k-2) e x (k-3)\(k-2-X)+ P{Y>k-2) 
~ X X F{Y ~ k ~ l) P{Y = k-2) 

< 2/X 
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by (|4.4p . Using (|4.8|) again, we have 

POO 

EI(Y + 1 < k - 2) / x(l + x^+^V^dx 

= V / x(i + x^-V^dxPOr + 1 = j) 
j=i Jo 

= E iUr p ( Y ^ i) - w ; ' p(y<j-i)]p(y = j-i) 



>(Y = j - 1) ^ J — A 1 , (fc - A) 2 



A ^ A 2 " A A 2 

This proves (|4.13jl . Similarly, 

poo 

EI(W < k — 2)W / x(l + x) w - l e~ Xx dx 
Jo 



poo 

< C(rik + l)(k-2)( x{l + x) {k - 2) - l e- Xx dx)P{Y > k - 2) 
Jo 



+C{r] k + 1)EI(Y <k — 2)Y / x(l + xy^e^dx 



oo 





< c( % + i)^ + c( % + i)(i + fc^; 

< + 1)(^ + ^!), 

which shows that (|4.14p holds. 
Next we prove Theorem 12.11 



Proof of Theorem \2.1\ Recall / := fh is the solution to the Stein equation 
with h(w) = I(w > k) for k > A. From (|4.5p and the definition of the neighb 
hood B>i, we have 

P(W > k) - P(Y > k) 

= ]T EXi[f(Yi + 1) - f(W)] +Y J P l E[f{W + 1) - f(Vi + 1)] 

iej iej 
='■ H3 + H4 

where := J2j^ Bl x j- 
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We bound H 4 first. Write {X k : k G = {X„ : 1 < j < \Bi\} where \Bi\ is 
the cardinality of B{ and -^Qibj = ^j- Then by the definitions of p,m, and the 
properties of /, (l4~6jL gTJ) and (l48jl . 



i£j 3=1 1=1 1=1 

3-1 3-1 

x [l(Vi + Y t X il + l>k-l) + I(V i + J2x i i + l<k-2)] 



< 



1=1 1=1 

'^ + El: 1 1 ^ + i>^-i) 



< 



> fc) / x(l + x) ( ^ +E '=i x « +1) - 1 e - Aa; ( ix/(^ + Vjr jl + i<* 

^ 1=1 
f CmJ(^> fc-l) 

iej 3=1 

> fc) y x(l + x) [H/A(fc - 2)] - 1 e- Ax dx/(Vl/ < A; + m, 1 < A; - 2) j 
< mp\CmP(W > k - 1) 

/>oo 

+P(T > fc)£?W/(l <k-2 <W <k + m) I x(l + x)(*- a )- 1 e- A!B da: 

JO 

/■oo 

+P(V > fe)Wi"(l <W <k-2) J x(l + x) w - x e- Xx dxy 
By P~10j) . P~3j) . dOH) and P~15|) of Lemma S3 (which will be proved later), 



|iT 4 | < CP(y > k)( Vk + 1) [m 2 ^ + mp ( k A)2 " 

A A 



Let ci > 1 be an absolute constant to be chosen later such that c\km < 9. By 
condition (|2.3p and the upper bound \ f(w) — f(w + 1)| < 1 A j- for all integers 
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w > 1 (see, for example, Barbour, Hoist and Janson (1992)), 

\Bi\-l j-l j 

\h 3 \ < Y. EXi E Xi J tt Vi + H X * + - f ( Vi + Y. Xii + *) 

i&J 3=1 1=1 1=1 

x [I(W < akm) + I(c x km < W < 9) + I(W > 9)] 

\Bi\-l j-l j 

< e sx * E ^p+E x a + ^ - /(^+E*« + ^ cikm ) 

i£j j = l 1 = 1 1 = 1 

+5(1 A \)EW 2 I{ Cl km < W < 9) + (1 A \)mEWI(W > 9) 
A A 

= : #3,1 + #3,2 + #3,3- 

Similarly as for \H^\, H31 can be bounded as follows. 
#3,1 

< 22 EX i E M y ' vJ -i y 71 I(W< Cl km) 

i£j j=1 Vi + 2_w = i Mi + 1 

-co . . i- 1 



r°° -1 ~i 

+P(Y > k) / x{\ + x)^ l+ ^=i x ^- l e- Xx dxI(Vi + y2x u + l<k-2)\ 
Jo 1=1 J 

< ' CmI(W w * " l) ^ w * ^ 

i&j 3=1 

[■CO - 

+P(y > k) I x(l + x)[ H/A ^ 2 )l- 1 e- A:!; (ix/(W < fc + m, 1 < fc - 2) j 

< 8EWCmI{k - I <W <cikm) 

[CO 

+5P(Y > k)EW 2 I{\ <k-2<W<k + m) x(l + x)^' 2 ^ 1 e~ Xx dx 

Jo 

rco 

+5P(Y > k)EW 2 I{\ < W < k - 2) / x(l + xJ^-V^dx 

< CP(Y > fc)(r? fc + l)£m 2 (A + (fc - A) 2 + ^ ~ A) ) 

A 

by ([430]) . ([43]) . and P~T5j) and (f¥7T6|) of lemma S3 (which will be proved later). 

Prom (|4.18p and (|4.19p of Lemma 14.51 (which will be proved later), there 
exists an absolute positive constant C such that for c\ > C and k < 9 /Cm, 



#3,2 + #3,; 

1 A 

A L m' 



1 c9 
< P(Y > k)(l A — ) \5m 2 + m 2 exp( )1 . 
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Therefore, 



\H 3 \ < CP{Y>k)(r, k + l)5m 2 {\ + {k-\) 2 + { 



A 



c9 

+P(Y > k)(l A -)m 2 exp( ) 

A m 



From the bounds on \H%\ and I-H4I, we have 

,P(W>k) ^ , . 2 ffi A , , XN2 , , r/ , , „ ^ 2 ,(k-\f 



1| < C(r ?fc + l)m 2 {^(A + (£;-A) 2 )+<5(A + (A;-A) 2 + 



1 P(Y >k) 1 - U v v / / ■ v ■ v / A 

+ (1 A-)m 2 exp(-C0), 
A 

Since the right-hand side of the above bound is increasing in k, we obtain the 
following recursive inequality for 77*.. 

|%-1| < C( m + l)m 2 {^(\ + (k-X) 2 ) + 8(X + (k-X) 2 + { -^^)} 

+(1 A \)m 2 exp( ). 

A m 

Solving the above inequality yields Theorem 12.11 □ 



Finally we prove the lemmas used in the proof of Theorem 12. 1[ 

Lemma 4.4. Let Y ~ Poi(X) with A > 0. Let W be an integer valued random 
variable and for integers k > A, let rj k be defined in (|4.9I) . Then we have 

EW 2 I(1 < k-2 <W< k + m) xil + x^-^e-^dx < C ^ - ™^ { Vk + 1) 

Jo A 

(4.15) 

and 

EW 2 (l <W< k-2) I™ x{l+x) w ~ l e- Xx dx < C(?7 fc +l)(A+(fc-A) 2 + ^ - X ^ ). 

Jo A 

(4.16) 



18 LOUIS H.Y. CHEN, XIAO FANG AND QI-MAN SHAO 

Proof. By (jTOD . (|Q1> and (|Oj> . 

/•oo 

EW 2 I(1 <k-2 <W <k + m) j x(l + xJ^-^-^-^da; 

JO 

< (* + m ) 2 w||^y P ( y > * - 1 > 1) jH *(1 + xf-^e^dx 

< (k + m) 2 C{r, k + l)P(y > Jfe - 1 > 1) [ eA( ^~ 2)! P(F = k — 2) 

e x (k — 3)\ k — 2 — X , Nl 
+ Afc - 2 A /(fe~2>A)] 

< ( t+m f Cfa+ i)[- + ff k__j ] 

< C ^l( Vk + l). 
Similar to the proof of (|4.14p . 

POO 

EW 2 (l < W < k - 2) / x(l + sJ^-^-^dx 
Jo 

POO 

< C( m + l){k-2) 2 { x{l + x) {k - 2) - l e- Xx dx)P{Y > k-2> 1) 

/"OO 

+C{r] k + l)£y 2 /(l <Y <k-2) x(l + x) Y - l e~ Xx dx. 



For the first term, applying (|4.8p and (|4.4p . 



/■oo 

! - 2) 2 ( / s(i + x)( fc - 2 )- 1 e - Ax (ix)p(y > fe - 2 > 1) 

■/ 

= (fe-2) 2 [ eA( A fc fc ~ 2)! p(y<fe-2) 

- eA( A fc fc r 2 3)! p ( y < ^ - 3)] p(y > - 2 > i) 

< (fc _ 2) 2 eA ^ fc ~ 2 ^ P(y = k - 2)P(Y > k - 2 > 1) 

N9 e A (fc - 3)! fc - 2 - A . 
+( k ~ 2 ) Afc -2 A P ( y > " 2 > 1) 

2A; 2 

< . 

~ A 



o 
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For the second term, 



/•oo 

EY 2 I{1 < Y < k - 2) / x(l + x) Y - l e~ Xx dx 
Jo 

fc--2 poo 

= V J 2 / x{\ + xy^e-^dxPiY = j) 

3 = 1 J ° 



* A — 

i>A 

< 1 + A + (fc _ A) 2 + (^)!. 

A 

The inequality (|4.16p is proved by combining the above bounds. □ 

To prove the next lemma, we need the following Bennett-Hoeffding inequal- 
ity. Let 1 < i < n} be independent random variables. Assume that E£i < 0, 
& < a{a > 0) for each 1 < i < n and ^™ =1 ££ 4 2 < B 2 n . Then for x > 

> *) < exp(--f {(1 + ^)log(l + -j) - -j}) 

In particular, for x > 4£? 2 /a 

P(f> > x) < exp(-^log(l + ||)) (4.17) 

Lemma 4.5. Lei Ti 7 be defined as in Theorem \2.1[ Then there exists an absolute 
constant C such that for k > A, 9 > Ckm and c\ > C, we have 

EWICW >9)<Cm exp( — — logfl + -^-)), (4.18) 

8m 2mA 

EW 2 I{W > cikm) < Cakm 2 exp(-^ log(l + (4.19) 

8 2A 

Proof. We follow the proof of Lemma 8.2 in Shao and Zhou (2012). Separate J 
into < I < m such that for each I, Xi,i £ J\ are independent. This can 
be done by coloring {Xi : i E J} one by one such that the X's with the same 
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color are independent. The total number of colors used can be controlled by m 
because of the assumption (I2.2D . Write 

wt = Y, x i- 

ieJi 

Then for C2 > 0, 

/■OO 

EWI(W > 2c 2 m) = 2c 2 mP(W > 2c 2 m) + 2m P(W > 2tm)dt 

< 2E(W - c 2 m) + + 2 / -E(W -tm)+dt 

roc 1 

< 2 E(W l -c 2 ) + + 2 / jE{Wi-t) + dt 

l<l<m l<K»ra C2 

For s > 5A Z := 5 J2 ieJi Pi , by (JUT}, 



P(W l>S ) < exp(-f log(l + f )). 

4 A; 



For i > c 2 > 5A/ 



/OO 

/■°° s s 

< J exp(--log(l + -))ds 



< 4exp(-Jlog(l + t/A0), 



/ < 4/ -exp(--log(l + t/A z ))dt 



' C2 " C2 

< — exp(-^log(l + c 2 /Ai)). 
c 2 4 

Combining inequalities above yields 

EWI{W > 2c 2 m) < 8mexp(- j log(l + c 2 /A))(l + 4/c 2 ). (4.20) 
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Similarly, for c\ big enough, 

EW 2 I(W > akm) 

/•oo 

= c 2 1 k 2 m 2 P(W > akm) + 2 xP(W > x)dx 

J cikm 

c\k 2 m 2 c\km-, 



' E (W - S^H)+ + 4 r E(W - -) + dx 

' 2 Jcikm 2 



c\km/2 

r U poo 

< 2 Cl km E(Wi-^) + +4 Y, / E(Wi-f-) + dx 

l<l<m 2 l<l<m Jc ^ km 

< 8ci/cm 2 exp( — — log(l + — )) + 16m / exp(— — log(l + - — - 

8 2A J Clkm 8m 2mA 

< 8 Cl km 2 exp(-^ log(l + |^)) + 128m 2 exp(-^ log(l + |^)). 



))dx 



2\" ' ^ 8 &v ' 2A 

This proves (B~T9]) . □ 
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